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EVENT DRIVEN MULTI-MEDIA COMMUNICATION MANAGEMENT SYSTEM 

Cross Reference to Related Applications 

The present application is a continuation in part of United States Patent 
5 Application 09/961 ,532 titled Teledata Space and Docking Station with Modular and 
Integrated Display filed on September 24, 2001, and is a continuation in part of 

United States Patent Application 09/ , filed on October 23, 2001, titled 

Modular Multi-Media Communication Management System, the contents of both 
such patent applications is incorporated herein. 
Q 10 Technical Field 

p.l The present invention relates generally to managing multi-media 

communications, and more particularly to a modular system for integrating and 
fis coordinating a subscriber's communication needs. 



Background of the Invention 



M 15 In today's fast paced business world, it is common for a person to rely on a 

ffl combination of communication devices, such as: desk top telephones, mobile 



telephones, cellular telephones, fax machines, pagers, and the like, as well as 
h= enhanced communication services, such as: voice mail, e-mail, text messaging 
and the like to accommodate their communication needs. 
20 In an office environment, desk top telephone service, voice mail service, and 

fax service is typically provided by a private telephone communication system. A 
contemporary private telephone communication system consists of a switching 
network, a plurality of desk-top telephones, and a voice mail server. The voice mail 
server is typically coupled to the switching network using a proprietary interface. 
25 Each desk top telephone and fax machine is coupled to the switching network by 
an extension line that consists of twisted pair conductors that are terminated by a 
telephone jack in the office. Communication between the desk-top telephone and 
the switching network over each extension line utilizes either proprietary digital 
signaling or plain old telephone service (POTS) signaling. The switching network is 
30 further coupled to the public switched telephone network (PSTN) using trunk lines 
that are connected to a central office switch that is typically managed by the local 
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telephone service provider The switching network controls calls between 
extensions and between an extension and a remote destination via a trunk line 
coupled to the PSTN. The switching network also routes calls to the voice mail 
server when an extension remains unanswered, is busy, or is otherwise 
5 programmed to route calls to voice mail. 

Recently fixed wireless networks have enabled wireless mobile telephones 
to be supported by the private telephone communication system. A wireless 
telephone controller is coupled to a wireless network in which a plurality of mobile 
telephones may be operated. The wireless telephone controller is coupled to the 
H 10 switching network of the private telephone communication system. In operation, 
P each mobile telephone is assigned an extension number and calls directed to that 
p extension are routed to the wireless telephone controller and then to the mobile 
ill telephone over the wireless network. Because the mobile telephone is equivalent 
ut to a desk-top telephone from the perspective of the private telephone 
I ^ 15 communication system, full voice mail services are supported for the mobile 
telephone. 

£-1 

IP E-mail service is typically provided by an e-mail service provider (either a 

M private system or an independent Internet mail service provider). An e-mail client 
on the person's desk-top and/or notebook computer is typically used for sending 
20 and receiving e-mail over a data network connection to the e-mail service provider. 

Cellular service is provided by a cellular service provider. A cellular handset 
is used to place and receive cellular telephone calls within the cellular service 
provider's network. Additionally, the cellular service provider may offer a voice mail 
service which prompts callers to leave a voice mail in the event that the cellular 
25 handset is busy or remains unanswered after several rings. Similarly, pager 
services are provided by a paging service provider. A one-way (or two-way) pager 
may receive (and send) text messages within the paging service provider network. 

A problem associated with the above systems is that there is a lack of 
integration and coordination among the services. This lack of integration and 
30 coordination causes a person to carry several devices with them as they do not 
know which telephone number a caller will choose to use. And, it causes a person 
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to check multiple voice mail systems and e-mail systems frequently to avoid delays 
in retuming calls or e-mails. 

Some of these problems can be eliminated, in theory, by vigilant use of call 
forwarding services to assure that incoming calls are fonA/arded, or funneled, to a 
5 single telephone that the person chooses to use at a particular time. However, call 
forwarding is unworkable if call fonA/ard programming cannot be changed remotely 
and is still time consuming if programming can be performed remotely. 

Other advancements in voice mail server technology have addressed the 
. ^ need to frequently check multiple voice mail systems. For example, some voice 
Q 10 mail servers send an audio file of a voice mail message to a specified e-mail 
Q address. This enables a person to retrieve voice mail messages through his or her 
e-mail client rather than dialing into the voice mail server. Additionally, some voice 
mail servers also initiate a call to a person's pager after a voice mail has been 
received to notify the person of a voice mail has arrived. 
15 While these advances have helped address the problems, they have not 

□ eliminated the need to have all such communication devices and the need to 

f% 



vigilantly check multiple systems for voice mail and/or e-mail messages throughout 
the day. 

What is needed is a multi media communication management system that 
20 allows for operator mobility that does not suffer the lack of integration and 
coordination of existing communication systems. 

Summary of the Invention 
The event driven multi-media communication management system 
comprises a controller that interfaces with a plurality of space station 
25 communication devices with their associated subscriber device(s) and with one or 
more communication medium service providers. The controller accesses 
subscriber directory information and automatically establishes a communication 
connection with a selected destination in response to the subscriber activating the 
associated subscriber device(s) or the space station communication device. 
30 The controller translates multi-media communications received from a multi- 

media service provider into the protocols required for use by the space station 
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communication devices as well as any convention telephone stations that may be 
coupled to the controller. The communication and control signaling between the 
controller and the space station communication devices may be wireless in nature 
with the space station communication devices being powered by an internal battery 
and/or connection to a local source of conventional line voltage. 

The architecture of the space station communication device is modular. 
Multiple functional elements can be interconnected with backbone communication 
circuitry to form an integrated communication platform. Modular docking interfaces 
may be used to couple the space station communication device to portable 
P 10 subscriber devices and to enable integrated and coordinated communication 
through multiple communication medium service providers. This coordinated and 
integrated system architecture enables the space station communication device to 

111 

g| merge the functionality and internal data of the various portable subscriber devices 
into the space station communication device, to direct the functionality and data of 
j'"" 15 the space station communication device to a selected one of the portable 
p subscriber devices, and to provide the subscriber with a simple subscriber 
H! interface. 



The controller further associates multi-media communication directory 
information with each subscriber device to provide communication channels 
20 between a communication space station and both other communication space 
stations and remote destinations across the multi-media communication medium. 

For a better understanding of the present invention, together with other and 
further aspects thereof, reference is made to the following description, taken in 
conjunction with the accompanying drawings, and its scope will be pointed out in 
25 the appended clams. 

Brief Description of the Drawings 

Figure 1 is a block diagram view of a modular multi-media communication 
management system in accordance with one embodiment of the present invention; 
Figure 2 is a perspective exploded view of a modular communication space 
30 station in accordance with one embodiment of the present invention; 

Figure 3 is a block diagram of a communication space station in accordance 
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with one embodiment of tlie present invention; 

Figure 4 is a block diagram of a multi-media communication management 
system controller in accordance with one embodiment of the present invention; 

Figure 5 is a block diagram of a subscriber data assistant in accordance with 
one embodiment of the present invention; 

Figure 6 is a block diagram of a wide area network communication device in 
accordance with one embodiment of the present invention; 

Figure 7 is a block diagram of a wireless dialog handset in accordance with 
one embodiment of the present Invention; 

Figure 8a shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure 8b shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure 8c shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure 8d shows a table diagram representing an exemplary state of 
operation of a communication management system in accordance with one 
embodiment of the present invention; 

Figure 9 shows table diagrams representing exemplary states of operation of 
a communication space station accordance with one embodiment of the present 
invention; 

Figure 10a shows table diagrams representing exemplary states of operation 
of a communication space station accordance with one embodiment of the present 
invention; and 

Figure 10b shows table diagrams representing exemplary states of operation 
of a communication space station accordance with one embodiment of the present 
invention. 
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Description of the Preferred Embodiments 

The present invention is now described in detail witli reference to the 
drawings. In the drawings, each element with a reference number is similar to 
other elements with the same reference number independent of any letter 
5 designation following the reference number. In the text, a reference number with a 
specific letter designation following the reference number refers to the specific 
element with the number and letter designation and a reference number without a 
specific letter designation refers to all elements with the same reference number 
independent of any letter designation following the reference number in the 
Q 10 drawings. A reference number followed by a "prime" symbol or a "double-prime" 

m 
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symbol represent an element that is a species embodiment of the more generic 
element designated by the reference number without a "prime" or "double-prime" 
designation. 

i'"' It should also be appreciated that many of the elements discussed in this 

:^15 specification may be implemented in hardware circuit(s), a processor executing 
software code, or a combination of a hardware circuit and a processor executing 



r 
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iJI code. As such, the term circuit as used throughout this specification is intended to 

CI 

^ encompass a hardware circuit (whether discrete elements or an integrated circuit 
block), a processor executing code, or a combination of a hardware circuit and a 
20 processor executing code, or other combinations of the above known to those 
skilled in the art. 

Referring to Figure 1, an exemplary architecture of the multi-media 
communication management system 10 of the present invention is shown. The 
multi-media communication management system 10 includes a control unit 12 that 

25 is coupled with a plurality of local communication devices 20 over a wireless local 
area network 22 (or by a wired network connection 23 to the backbone wired 
network of the wireless local area network 22). The local communication devices 
20 may include: subscriber stations 24 (communication space stations 24), wireless 
dialog handsets 26, traditional telephone handsets 28, traditional fax machines 30 

30 (both coupled through communication space station 24), traditional computer 
systems 32, network printers 46, and various network appliances 34. 
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In operation, the control unit 12 integrates and manages multi-media 
communication between the local communication devices 20 and between each 
local communication device 20 and a remote service provider (not shown) over the 
service provider's multi-media communication medium 18. More specifically, the 
control unit 12 translates received multi-media communication signals from the 
multi-media communication medium 18 (or a source local device 20) to the 
protocols required for use by the destination local communication device 20 (or the 
multi-media communication medium 18). 

The control unit 12 includes a multi-media communication service provider 
bay 14 which operatively couples one of a plurality of communication medium 
modules 16a-16d to the control unit 12. Each communication medium module 1 Ba- 
led is configured to interface with a service provider's multi-media communication 
medium 18a-18d. For purposes of illustration, communication module 16(a) may 
be a cable modem module for communicating over coaxial cable 36 with a multi- 
media communication service provider such as a local cable company, 
communication module 16(b) may be a wide area network radio for communication 
over a wireless spectrum channel 38 with a wide area wireless multi-media 
communication service provider such as an analog or digital cellular/PCS telephone 
service provider, communication module 16c may be a customer service unit (CSU) 
for communication over a T1 line 40 with a multi-media communication provider 
such as a local telephone service provider, and communication module 16d may be 
an optical modem for communication over a fiber channel 44 with a fiber optic multi- 
media communication service provider. It should be appreciated that the examples 
of communication modules 16a-16d are for illustrative purposes only and it is 
recognized that multi-media communication services may be provided by other 
service providers utilizing other communication technologies such as satellite RF or 
other. For purposes of this invention, a communication module 16 includes circuitry 
for interfacing between the control unit 12 and a selected multi-media 
communication service provider. The control unit 12 further comprises a circuit 
switched provider bay 24 which operatively couples one or more public switched 
telephone network (PSTN) channels 42. 
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Communication Space Station 

Referring to Figure 2, a perspective view of an exemplary communication 
space station 24 is shown. The communication space station 24 includes a 
platform unit 52 that operatively couples to the control unit 12 via either a wireless 
5 communication link between a platform unit network circuit 96 and the wireless 
network 22 or a direct network connection 23 between the platform unit 52 and the 
backbone network of the wireless network 22. 

A plurality of functional modules 54, 56, 58, and 60 may be coupled to the 
. platform unit 52 to form an integrated multi-media communication platform. The 

P 10 platform unit 52 includes a subscriber Interface docking platform 64 for coupling 
□ and optionally supporting one of a plurality of modular subscriber interface units 60 
p to the platform unit 52. The modular subscriber interface unit 60a may include a 
t$ plurality of buttons 68 in an arrangement similar to a typical telephone key pad to 



provide for subscriber input in a manner similar to that of a traditional telephone 
15 handset. The modular subscriber interface 60b may include a liquid crystal touch 



The platform unit 52 further includes a first function specific docking platform 
74a and a second function specific docking platform 74b, each of which will couple 
20 to a plurality of function specific modules 54 and 56. The first function specific 
docking platform 74a is a shallow platform for coupling to function specific modules 
that primarily comprise function specific buttons or other circuits that may be placed 
within a thin module. The second function specific docking platform 74b is a larger 
platform for coupling to function specific modules with more complex internal 
25 circuits requiring the additional size. 

In the exemplary embodiment, the function specific module 54 may include 
subscriber interface buttons configured for enhancing dialog communication 
through the communication space station 24 such as an audio message control 76 
for single button access to audio message files and dialog management controls 86 
30 for single button control of enhanced dialog management functions. 




panel display 72 to provide for subscriber input through virtual buttons visible 
thereon. 



The function specific module 56 may include circuits configured for 
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enhancing data communication througli the communication space station 24 such 
as an electronic message control 78 for single button access to subscriber 
electronic messages, a print control 80 for single button initiation of the printing of a 
subscriber electronic message file, and multiple data networking ports 84. 
5 The platform unit 52 further includes a docking bay 62 into which a modular 

docking interface 58 may be secured and operatively coupled to the platform unit 
52. The modular docking interface 58 supports one of a plurality of modular 
subscriber devices 50 within a subscriber device interface bay 66 and provides for 
operatively coupling the modular subscriber device 50 to the platform unit 52. The 

p 10 modular docking interface further includes a plurality of control buttons 92 for single 

gf button selection of functions Indicated on a display 90 on the subscriber device 50. 

fll Exemplary configurations for the modular subscriber device 50 include a 
subscriber data assistant 86, a subscriber wide area network communication device 

^ 88, and the wireless LAN dialog handset 26, each of which is discussed in more 

15 detail herein. 

j1| While operatively coupled to the platform unit 52, the subscriber device 50 

CI becomes an integral part of the subscriber interface of the communication space 
station 24. A liquid crystal display 90 on the subscriber device 50 may function to 
display multi-media communication management information under control of the 

20 platform unit 52 and the control unit 12. Further, programmable subscriber controls 
92 positioned adjacent to the subscriber device 50 may be configured to activate 
platform unit 52 and control unit 12 functions in accordance with the contents of the 
display 90 adjacent to the controls 92. 

The platform unit 52 may further include one or more of the following 

25 elements: a handset 98 similar to a traditional telephone handset to provide a 
subscriber voice interface, a speaker 100 and a microphone 102 to provide a 
hands-free subscriber voice interface, a modular battery pack 70 (which fits within a 
battery pack bay that is not shown) for operating power when the communication 
space station 24 is uncoupled from a line voltage, an on/off hook control button (or 

30 switch), and a help control button 104, a WAN control button 104, and a directory 
control button 107, for single button selection of certain functions such as a help 



9 



13944.102 Tel-003 

function, a wide area network communication function, display of a contact directory 
respectively. 

Figure 3 shows a block diagram of the communication space station 24. The 
platform unit 52 includes a controller 112 operating a packet voice application 113, 
5 a Communication Space Station application 115, and applicable drivers for a 
plurality of peripheral controllers. The controller 112 is coupled to a local bus 116 
that interconnects the application controller 112 with each of the plurality of 
peripheral controllers that include a wireless module 94, a power management 
controller 120, a communication controller 122, a network switch controller 124, a 
p 10 key switch controller 126, a touch panel controller 128, a plain old telephone 
^fj service (POTS) converter 146, and a voice communication system 130. 
^ The wireless module 94 operatlvely couples the platform unit 52 with the 

Sii control unit 12 over the wireless LAN 22 (both of Figure 1). The power 
management controller 120 selectively receives input power from the battery pack 
M 15 70 or external line voltage 134. The power management controller 120 includes 
g appropriate circuits for converting the input power voltage to appropriate operating 

power required by each component of the communication space station 24. 
hJ» Additionally, the power management controller 120 includes appropriate circuits for 
charging the battery pack 70 when the platform unit 52 is coupled to the line 
20 voltage 134 and generating appropriate power for operating and/or charging the 
modular docking interface 58 and the modular subscriber device 50 when coupled 
to the platform unit 52. 

The communication controller 122 operatively couples the modular docking 
interface 58 and the modular subscriber device 50 to the controller 112 such that 
25 the platform 52 can exchange data with the modular subscriber device 50. In the 
exemplary embodiment, the communication controller is a serial communication 
controller that enables the serial exchange of data with a compatible serial 
communication controller within the modular subscriber device 50 over a physical 
medium. Exemplary physical mediums include hardwired contacts, an infrared 
30 transmission, and RF transmission, however other physical mediums are 
envisioned and the selection of a physical medium is not critical to this invention. 
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The network switch controller 124 provides a network data port circuit which 
enables the controller 112 to communication with another network computing circuit 
over a network interface. The network switch controller 124 is coupled to a bus port 
135 within the function specific docking platform 74b for coupling to a mating port 
5 148 on the function specific module 56. 

The key switch (e.g. button) controller 126 is coupled to: a connector 136a 
which in turn is coupled to a mating connector on the modular subscriber interface 
unit 60a (Figure 2) for interconnecting the buttons 68 to the key switch controller 
126; a connector 136b which in tum is coupled to a mating connector 142 on the 
p 10 function specific module 54 for interconnecting the buttons 76 and 86 to the key 
% switch controller 126; the bus port 135 which in turn is coupled to a mating port 148 
on the function specific module 56 for interconnecting tlie buttons 78 and 80 to tlie 

ni 

g(i l<ey switch controller 126; and the help control button 105, the WAN control button 
104, the directory button 107, and the on/off hook button (or switch) 109. In the 

Y^15 exemplary embodiment, the key switch controller 126 may drive row and column 



ill 

PI 



signals to the various buttons and. upon detecting a short between a row and a 
column (e.g. button activation) reports the button activation to the controller 112 
over the bus 116. 

The touch panel controller 128 is coupled to a connector 144 which in turn is 
20 coupled to a mating connector on the modular subscriber interface unit 60b (Figure 
2) for interconnecting the touch panel 72 to the touch panel controller 128. In the 
exemplary embodiment, the touch panel controller 128 may include a separate 
display control circuit compatible with the resolution and color depth of the display 
of touch panel 72 and a separate touch panel control circuit for detecting subscriber 
25 contact with the touch panel 72. 

The audio communication system 130 generates analog audio signals for 
driving the speaker 100 (or the speaker in the handset 98 of Figure 2) and detects 
input form the microphone 102 (or the microphone in the handset 98) under the 
control the packet voice application 113 operated by the controller 112. 
30 The POTS converter circuit 146 provides a standard POTS port signal (e.g. 

tip and ring) for operation of a traditional telephone or a traditional fax machine 
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coupled to a POTS port 82 on the function specific module 56. In operation the 
POTS converter 146 circuit interfaces between the POTS signal and the application 
controller 112. 
Control Unit 

5 Figure 4 shows a block diagram of the control unit 12 in accordance with an 

exemplary embodiment of the present invention. As discussed previously, the 
control unit 12 includes a multi media communication service provider bay 14 which 
operatively couples one of a plurality of communication medium modules 16 to the 
I control unit 12 for providing an interface to a service provider's multi-media 

Cl 10 communication medium. The control unit 12 further includes a local area network 
p management system 214, a voice converter circuit 218, a voice server 226, a 
packet voice gateway 232, a session control server 230, messaging client 228, and 

1 u 

ai a subscriber contact directory database 234. 

The local area network management system 214 manages the 
f'"' 15 communication of data between the control unit 12 and each of the local 
communication devices 20 (Figure 1). The local area network management system 



ill 



226 may include an address server 220 for assigning a network address (from a 
block of available network addresses) to each local communication device 20 upon 
the local communication device subscribing to the wireless network 22 and 
20 requesting a network address. The local area network management system 214 
may also include a proxy server 222 for communicating with remote devices via the 
service provider multi-media communication medium 18 on behalf of each of the 
local communication devices 20. 

A port control circuit 216 may interconnect the local area network 
25 management system 214 to each of the wireless network 22, the packet voice 
gateway 232, the session control server 230, and the messaging client 228 over 
standard network port connections. 

The messaging client 228 provides for authenticating a subscriber to a 
remote messaging server (not shown) coupled to the service provider multi-media 
30 communication medium 18 and copying a plurality of subscriber messages from 
such messaging server. 
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The voice server 226 provides audio prompts for providing a voice interface 
to accept an audio message for a subscriber, store the message as a digital file, 
and send the digital file to the remote messaging server associated with the 
subscriber. 

The session control server 230 operates the protocols for sending multi- 
media content messages and control messages to each local communication 
device 20 over the wireless local area network 22. In the exemplary embodiment, 
the communications between the session control server 230 and each local 
communication device occurs using tagged messages. The tag for each message 
identifies the content of the message to the recipient local communication device 
20. The packet voice gateway 232 operates provides real time voice 
communications between local communication devices 20 and between a local 
communication device 20 and a remote voice communication device over either the 
multi-media communication service provider medium 14 or the circuit switched 
channel 42. The packet voice gateway 232 includes a table 233 which affiliates 
each subscriber device 50 with the communication space station 24 serving the 
subscriber device 50. 

The packet voice gateway 232 receives audio session signaling from each of 
the communication space stations 24, the service provider medium 14, and the 
circuit switched channel 42 (via the voice converter 218) and established audio 
session signaling to destination network address in accordance with the table 233. 
After signaling an audio session channel is established between the packet voice 
gateway 232 and the communication space station 24 and an audio session 
channel is established between the packet voice gateway 232 and the destination. 
The packet voice gateway 232 relays audio session communications between the 
two channels. 

The subscriber contact database includes a contact directory for each of a 
plurality of subscribers. Within each contact directory are a plurality of contact files 
that include basic information associated with the contact such as company name, 
telephone number, e-mail address, mailing address, fax number and the like. The 
contact directory provides destination information which may be used by the packet 
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voice gateway 232 and the session control server 230 for establishing 
communication channels from a communication space station 24 to a selected 
contact. 

The voice converter 218 functions to convert audio signals compatible with 
the circuit switched channel 42 to packet voice signals compatible with the voice 
server 226 and the packet voice gateway 232 and, in reverse, functions to convert 
packet voice signals to audio signals compatible with the circuit switched channel 
42. Further, the voice converter 218 functions to convert a coded extension 
number (e.g. DID signal) that may be included within audio session signaling 



O 10 through the PSTN interface 24 to a digital format compatible with the packet voice 
P| gateway 232. Each of the local area network management system 214, the packet 
^? — voice gateway 232, the voice converter 218, the voice server 226, the session 
control server 230, and the messaging client 228 operate as an integrated system 



under the control of the session control server 230. 



IS Subscriber Data Assistant 

Q Turning to Figure 5, exemplary structure of a subscriber data assistant 86 is 



shown. The subscriber data assistant 86 includes a controller 160 operating a 
Communication Space Station client application ,174, a subscriber contact directory 
application 178, and applicable drivers 176 for a plurality of peripheral controllers. 

20 The controller 160 is interconnected to the plurality of peripheral controllers by an 
internal bus 162. Because of the small size and the portability of the subscriber 
data assistant 86, the touch panel 90 provides the primary subscriber interface. 
The touch panel 90 is controlled by a display controller 164 and a touch panel 
controller 166. The display controller 164 drives the liquid crystal display of touch 

25 panel 90 using signals compatible with the resolution and color depth of the display 
90. The touch panel controller 166 detects user activation of the touch panel 90. 

A communication controller 168 is also coupled to the bus 162 and operates 
under control of the application controller 160. In the exemplary embodiment, the 
communication controller 168 is a serial communication controller that is compatible 

30 with the communication controller 122 of the platform unit 52 (both of Figure 3) 
such that data communication may occur between the platform unit 52 and the 
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subscriber data assistant 86 when the subscriber data assistant 86 is operatively 
coupled to the platform unit 52. 

A power management circuit 170 selectively receives input power from a 
battery pack 172 or from the power management circuit 120 in the platform unit 52. 
5 The power management circuit 170 includes appropriate circuits for converting the 
input power voltage to appropriate operating power required by each component of 
the subscriber data assistant 86. Additionally, the power management circuit 170 
includes appropriate circuits for managing charging of the battery pack 172 when 
\^ subscriber data assistant is coupled to the platform unit 52. 

^ 10 The Communication Space Station client application 174 provides for 

P displaying multi-media communication management information under control the 

SI 

fil platform unit 52 when coupled to the platform unit 52. In the exemplary 



embodiment the Communication Space Station client application 174 receives 
p content messages and control messages from the platform unit 52 in the form of 

^1, 15 tagged messages. After receipt of the tagged messages, the Communication 

ifi 



rf. Space Station client application 174 builds a display document to display the 



communication management information represented by tagged content messages 
in accordance with display layout control messages that are compatible with the 
size, resolution, and color depth of the touch panel display 90. The display 

20 document is then displayed on the touch panel display 90. 

The subscriber contact directory application 178 maintains a contact 
directory file for each of a plurality of subscriber contacts. The application 178 also 
may permit the subscriber to add contact information and edit contact information 
through the touch panel 90 when the subscriber data assistant 86 is uncoupled 

25 from a communication space station 24. 

It should be appreciated that in additional to operating the drivers 176, the 
Communication Space Station client application 174, and the subscriber contact 
directory application 178, the controller 160 may optionally operate any of the other 
software applications that are commercially available for portable data assistants 

30 (PDAs). While operation of such PDA applications may be useful to the subscriber, 
it is not critical to the operation of the present invention. 
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Subscriber Wide Area Network Communication Device 

Turning to Figure 6, exemplary structure of a subscriber wide area network 
communication device 88 is shown. The wide area network communication device 
88 includes a controller 180 operating a Communication Space Station application 
5 174\ the subscriber contact directory application 178, a wireless communication 
application 194, and applicable drivers 196 for a plurality of peripheral controllers. 
The controller 180 is interconnected to the plurality of peripheral controllers by an 
internal bus 186. The peripheral controllers include a wide area network RF circuit 
182, a voice system 197, a display controller 184, a touch panel controller 185, a 

p 10 key switch controller 193, a communication controller 188, and a power 
management system 190. 

^1* The wide area network RF circuit 182 may be a circuit for transmitting and 

M receiving signals from a wide area network service provider's medium under control 
of the wireless communication application 194. Exemplary wide area network 
15 service provider mediums include an analog or digital cellular or PCS telephone RF 

ill system. 

^ The key switch controller 193 is coupled to the control buttons 195. The key 

switch controller 193 drives row and column signals to the control buttons 195 and, 
upon detecting a short between a row and a column indicating button activation, 
20 reports the activation to the controller 180. The control buttons may be used by a 
subscriber for operating the wide area network communication device 88 when 
uncoupled form the platform unit 52. 

The voice system 197 includes a speaker and a microphone. Under control 
of the wireless communication application 194, the voice system 197 may provide a 
25 subscriber voice interface for an audio session with a remote device over the wide 
area network service provider's medium. 

The display controller 184 drives the display 90 using signals compatible 
with the resolution and color depth of the display 90. The display 90 may optionally 
be a touch panel display 90 and the touch panel controller 185 detects user 
30 activation of the touch panel 90. 

The communication controller 188 may be a serial communication controller 
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compatible with the communication controller 122 in the platform unit 52 such that 
data communication may occur between the platform unit 52 and the wide area 
network communication device 88 when the wide area network communication 
device is operatively coupled to the platform unit 52. 

The power management controller 190 operating with a battery pack 192, 
both of which may operate in a similar manner to the power management controller 
170, and the battery pack 172 discussed with reference to Figure 5. 

Similar to the subscriber data assistant 86 (Figure 5), when the wide area 
network communication device 88 is coupled to the platform unit 52, the 
Communication Space Station application 174' provides for displaying multi-media 
communication management information under control the platform unit 52 and 
provides for multi-media communication directly between the platform unit and the 
wide area network service provider medium. 

In addition the Communication Space Station application 174' may receive 
messages from the platform unit 52 which may be multi-media communication 
messages for communication over the wide area network service provider medium. 
Each message includes a tag that identifies the contents of the message. After 
receipt of a tagged message, the Communication Space Station application 174' 
may identify whether the message is for communication with the wide area network 
service provider medium or whether it is multi-media communication management 
information for display. 

When the message is for communication with the wide area network service 
provider medium, the Communication Space Station application 174' will reformat 
the message to a format compatible with wide area network service provider 
medium transmission standards and transmit the message using the wide area 
network RF circuit 182. 

The wide area network communication device 88 may also receive signals 
from the wide area network service provider medium via the wide area network RF 
circuit 182. When received, the Communication Space Station application 174' 
reformats the messages into a plurality of tagged messages for communication to 
the platform unit 52 and sends the tagged messages to the platform unit 52 via the 



17 



13944.102 Tel-003 

communication controller 188. 
Wireless Voice Handsets 

Figure 7 shows a block diagram of an exemplary wireless dialog handset 26. 
The wireless voice handset 26 includes a network circuit 278 and a controller 250 
5 that operates a Communication Space Station application 174", the subscriber 
contact directory application 178, a LAN communication application 252, and 
applicable drivers 254 for each of a plurality of peripheral controllers. The controller 
250 is interconnected by a bus 276 to the plurality of peripheral controllers which 
include a module controller 258, a display driver 260, a touch panel driver 261, a 
P 10 key switch controller 264, and a power management circuit 270. 

The module controller 258 operatively couples the network circuit 278 to the 
CO controller 250 such that the wireless voice handset 26 may communicate with the 

rti 

f4l control unit 12 over the wireless LAN 22 (both of Figure 1). In the exemplary 
embodiment, the module controller 258 may be a PCMCIA controller circuit and the 
M 15 network circuit 278 is configured as a PCMCIA card that coupled to the module 
h controller 258 through a PCMCIA connector 272. The LAN communication 
application 252 operates the network circuit 278 for communicating with the control 

CI 

hs« unit 12 using appropriate wireless signaling protocols. 

The key switch controller 264 is coupled to the control buttons 266. The key 
20 switch controller 264 drives row and column signals to the control buttons 266 and, 
upon detecting a short between a row and a column indicating button activation, 
reports the activation to the controller 250. The control buttons may be used by a 
subscriber for operating the wireless voice handset 26 when uncoupled form the 
platform unit 52. 

25 The display controller 260 drives the display 90 (optionally a touch panel 

display 90) using signals compatible with the resolution and color depth of the 
display 90. The touch panel controller 261 detects user activation of the touch 
panel display 90. The power management controller 270 operates in conjunction 
with a battery pack 268, both of which may operate in a similar manner to the 

30 power management controller 170, and the battery pack 172 discussed with 
reference to Figure 5. 
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When the wireless voice handset 26 is coupled to the platform unit 52, the 
Communication Space Station application 174" provides for displaying multi-media 
communication management information under control the platform unit 52. 
Additionally, the Communication Space Station application 174" may receive multi- 
5 media communication management information content messages and control 
messages directly from the control unit 12 via the wireless network 22. After receipt 
of the tagged messages from either the platform unit 52 or the control unit 12, the 
Communication Space Station application 174" builds a document to display the 
communication management Information represented by the tagged content 
p 10 messages in accordance with display layout control messages that are compatible 
^ with the size, resolution, and color depth of the touch panel display 90. The display 

51 document Is then displayed on the touch panel display 90. 

fi'l 

Session Control Server 

^'^^ Referring to Figure 4 in conjunction with the tables of Figures 8a-8e, 

15 exemplary operation of the session management server 230 providing multi-media 
K communication management in accordance with the present invention is shown. 
'IJ The session control server 230 operates as a multi-tasking event driven 

state machine. A separate state machine is operated by the session control server 
230 for each of the local communication devices 20 (Figure 1). During operation of 
20 each state machine, the session control server 230 receives event signals from 
each of the voice server 218, the messaging client 228, the packet switched voice 
gateway 232, the multimedia communication service provider medium 18, and the 
particular local communication device 20 for which the state machine is operated. 
Each state machine includes multiple processing states and within each processing 
25 state there is a plurality of events that may be detected by the session control 
server 230. Each event has a processing state dependent processing sequence 
that is processed by the session control server 230. 

The table of Figure 8a represents a start up state. In the start up state, the 
session control server 230 is waiting for an open session request from a new 
30 subscriber device 24 on a predetermine port. When a communication space station 
24 has just operatively coupled to the local area network 22, obtained a network 
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address from the network address server 220, and is ready to operate, it is 
progrannmed to send an open session request to a predetermined network address 
(matching that of the session control server 230) on the predetermined port. Event 
300 represents receipt of an open session request form the subscriber station 24. 
5 In response, various steps are performed to initiate management of multi-media 
communications of the subscriber station 24 that include: providing logon scripts to 
the subscriber station 24; obtaining an interface configuration of the subscriber 
station 24; providing main menu display content and main menu layout control 
messages to the subscriber station 24 that are compatible with the particular 
H'^ 10 display (if any) that is included in the interface configuration of the subscriber 
□ station 24; and transitioning to a main menu state 304 as represented by Figure 8b. 

When In the main menu state 304, the session control server 230 is waiting 
ry for one of a plurality of events to occur that may include event 302 that represents a 
messajge indicating subscriber selection of a menu choice from the main menu, 
15 event 308 that represents a message from the subscriber station 24 indicating that 
a subscriber device 50 (Figure 1) has been operatively coupled to, and is ready to 
be served by, the subscriber station 24, and event 310 that represents a message 
P indicating subscriber activation of the help control 105 (Figure 2). 

In response to event 302, the session control server 230 transitions to a 
20 state corresponding to the selected menu choice. In response to event 308, the 
session control server performs a plurality of steps to associate the subscriber 
device 50 with the subscriber station 24. Messages representing extraction control 
scripts may be sent to the subscriber station 24 which provide for the subscriber 
station to obtain identification information associated with the subscriber device 50 
25 and send the identification information to the session control server 230. Messages 
are received from the subscriber device 50 to provide for receiving subscriber 
contact files to update the subscriber contact directory database 234 with any edits 
to the subscriber contact files that may have been made when the subscriber 
device 50 was uncoupled form the subscriber station 24. Subscriber contact 
30 information from the subscriber contact direction 234 may be communicated to the 
subscriber device 50 to update the subscriber contact files stored on the subscriber 
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device 50. Main menu display content messages and main menu display layout 
control messages that are compatible with display 90 on the particular subscriber 
device 50 are sent to the subscriber station 24 to effect the display of a main menu 
on the display 90. Following completion of these steps, the session control server 
5 230 transitions to a subscriber device main menu state 316 as represented by 
Figure 8c. 

In response to event 310, the session control server 230 provides control 
scripts to the subscriber station 24 to provide for the subscriber station 24 to 
establish the appropriate audio session channels to the voice gateway 232 and for 
y 10 the voice gateway 232 to access the session control server 230 through the voice 

y 

□ converter 218, and transitions to an audio help state wherein a subscriber is 

f^y directed through a sequence of help menu choices by audio prompts initiated by 

® the session control server 230. 

ill When in the subscriber device main menu state 316 of Figure 8c, the 

. 15 session control server 230 is waiting for one of the events associate with the 



CI subscriber device main menu state that include event 312 that represents a 

ill 

message indicating subscriber selection of a menu choice from the subscriber 
device main menu, event 320 that represents a message indicating subscriber 
activation of the help control 105 (Figure 2), event 322 that represents a message 

20 indicating subscriber activation of the message control 78 (Figure 2), event 324 that 
represents a message indicating subscriber activation of the audio message control 
76 (Figure 2). event 314 that represents a message indicating subscriber activation 
of the directory control 107 (Figure 2), and event 326 that represents a message 
indicating that the subscriber device 50 is not longer served by the subscriber 

25 station 24. 

In response to event 312, the session control server 230 transitions to a 
state corresponding to the selected menu choice. In response to event 320, the 
session control server 230 provides messages representing help menu display 
content and help menu display layout control in accordance with the parameters of 
30 the display 90 on the subscriber device 50 and then transitions to a graphic help 
state wherein the subscriber is directed through a sequence of graphic help menu 
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choices through various levels of display menus provided to the subscriber station 
24 through help menu display content messages and help menu display layout 
control messages. In response to events 322 or 324 the session control server 230 
obtains messages associated with the subscriber device from a remote messaging 
5 server coupled to the service provider medium, sorts the messages in accordance 
with the message type selection, provides messages representing message list 
display content and message list display layout control in accordance with the 
parameters of the display 90 on the subscriber device 50, and then transition to a 
message list state 328 (Figure 8d). In response to event 314 the session control 
PI 10 server 230 obtains subscriber contact information that corresponds with the 



subscriber device, provides the directory content and display layout control 
messages to the subscriber station 24, and transition to a subscriber directory state 

ry 

370 as represented by the table of Figure 8e. In response to event 326 the control 
unit transitions to the main menu state 304 (Figure 8b). 
\^ 15 When in the message list state 328 of Figure 8d, the session control server 

pi 230 is waiting for one of a plurality of events associated with the message list state 
Wi 328 that include event 334 that represents a message indicating that the subscriber 
has activated a control to obtain an audio message from the list (either by touch 
panel activation or by buttons 92 of Figure 2), event 336 that represents a message 
20 indicating that the subscriber has activated a control to display a message from the 
list (either by touch panel activation of by buttons 92 of Figure 2), event 338 
representing a message indicating that the subscriber has activated the print 
control 80 (Figure 2), event 340 that represents a message indicating subscriber 
activation of the help control 105 (Figure 2), and event 342 that represents a 
25 message indicating that the subscriber device 50 is not longer served by the 
subscriber station 24. 

In response to event 334 the session control server 230 communicates the 
selected audio message files to the subscriber station 24 and provides control 
scripts to the subscriber station 24 to provide for the subscriber station to output the 
30 message through the voice system 130. In response to event 336 the session 
control server 230 provides display content and display layout control that are 
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compatible with parameters of the display 90 on the subscriber device 50 for 
display of the selected message and then transitions to a message display state. 
In response to event 338, the session control server 230 formats the selected 
message into a printer compatible file, send the print file to a printer coupled to the 
5 network 22, and return to the message list state 328. In response to event 340 the 
session control server 230 provides messages help menu display content and help 
menu display layout control messages in accordance with the parameters of the 
display 90 on the subscriber device 50 and then transitions to the graphic help 
state. In response to event 342 the control unit transitions to the main menu state 
5J 10 (Figure 8b). 

p When in the subscriber directory state 370 the session control server 230 is 

S| waiting for an event associated with the subscriber directory state 370 which may 

• ■?* 

include event 372 that represents receipt of a message representing a contact 
f selection that indicates that either an applicable portion of the touch panel was 

Uiit 

^ 15 activated or a particular button 92 (Figure 2) was activated to indicate subscriber 
O selection of a contact, event 374 that represents receipt of a message that 
|| indicates subscriber activation of the help control 105 (Figure 2), and event 378 that 
'^""^ represents a message indicating that the subscriber device 50 is no longer served 
by the subscriber station 24. 
20 In response to event 372, the session control manager 230 communicates a 

control script to the subscriber station 24 that provides for the subscriber station 24 
to establish the appropriate audio session channels to the voice gateway 232 and 
for the voice gateway 232 to establish an appropriate audio session channel to a 
destination associated with the selected contact. The control script may include a 
25 telephone number from the subscriber contact directory database 234 associated 
with the contact. Following communication of the control script, the session control 
server 230 transitions to an audio session state. 

In response to event 374, the session control server 230 provides messages 
representing help menu display content and layout control and then transition to the 
30 graphic help state. In response to event 378, the session control server 230 
transitions to the main menu state 304. 
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Communication Space Station Application 

In the exemplary embodiment, the Communication Space Station application 
115 is an event driven state machine. Within each processing state various events 
that are generated by one of the peripheral circuits may be detected by the 
5 Communication Space Station application 115 and, upon detecting an event, a 
certain string of processing steps that correspond to the particular event is 
performed by the Communication Space Station application 115. 

Referring to the tables of Figures 9a and 9b in conjunction with the block 
diagram of Figure 3, exemplary operational states of the Communication Space 
10 Station application 115 are shown. The start up state 346 represents the state of 
operation of the subscriber station 24 immediately after establishing a network 
fu connection with the control unit 22 via the network 22. Upon establishing a 
'f^ connection, event 366, the Communication Space Station application 115 initiates a 
p session request to the session control server 230 on a predetermined port. Event 

Q 15 368 represents confirmation of the session from the session control server 230 and 
G| receipt of the logon script from the session control server 230. In response to event 

if g 

p 368, the subscriber device processes the script which may include detecting the 
^^"^ interface configuration of the subscriber device 24, providing the interface 
configuration to the session control server 230, and transitioning to the base state 
20 344. 

The base state 334 represents the Communication Space Station application 
115 waiting for an event signal from one of the peripheral devices which may 
include event 354 that represents subscriber touch panel activation, event 356 that 
represents subscriber activation of one of the control buttons, event 358 that 

25 represents receipt of display content and display layout control messages from the 
controller 12, event 360 that represents receipt of a message comprising a 
processing script from the controller 12, event 362 that represents a wide area 
network telephone signal through a wide area network subscriber device 88 (Figure 
1), event 364 that represents detecting a subscriber device 50 being coupled to the 

30 subscriber station 24, event 350 that represents receipt of a message from the 
controller 12 directed to the subscriber device 50, and event 352 that represents 
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receipt of a message from the subscriber device 50 directed to the controller 12. 

In response to event 356, the application 115 provides a message indicating 
the touch panel activation event to the session control server 230. In response to 
event 358, the application 115 provides a message indicating activation of the 
particular control button to both the packet voice application 113 and the session 
control server 230. In response to event 358, the application 115 either updates 
the display 72 on the touch panel unit 60b (both of Figure 2) via the touch panel 
controller 128 or provides the messages representing the display content and the 
display layout control to the subscriber device 50 via the communication controller 
122 for the subscriber device 50 to update its own display. In response to event 
360, the subscriber device processes the script as provided including interfacing 
with any of the peripheral devices as required by the script. For example, the 
extraction control script received from the session control server 230 may require 
interrogating the subscriber device for identity information and providing a message 
representing such identification information to the session control server 230. In 
response to event 362, the subscriber device may enter a wide area network 
communication state wherein it relays a digital representation of voice signals 
between the dialog system 130 and a wide area network subscriber device 88 such 
that a voice conversation may take through the wide are network. In response to 
event 364, the subscriber device 24 may send a message indicating that a 
subscriber device 50 is being initialized by the subscriber station 24 (which 
corresponds to event 308 of Figure 8b) and then return to the base state 344. In 
response to event 350, the application 115 provides the messages to the 
subscriber device 50 via the communication controller 122. In response to event 
352, the application 115 provides the messages to the session control server 230 
via the network. 
Packet Voice Application 

The packet voice application 113 also operates as an event driven state 
machine. Again, each state includes a plurality of events that may occur when 
operating in the state and a sequence of steps that the packet voice application 
processes in response to the event. Referring to the tables of Figures 10a and 10b 
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in conjunction with the block diagram of Figure 3, exemplary operational states of 
the packet voice application 113 are shown. 

The stand by state 280 represents the packet voice application in an inactive 
mode waiting for an event that may include event 388 which represents receipt of 
5 an audio session set up signal from the packet voice gateway 232, event 390 that 
represents receipt of a message from the Communication Space Station application 
115 that represents activation of the on/off hook button (or switch) 109, and event 
392 that represents receipt of a message from the Communication Space Station 
application 115 instructing the packet voice application 113 to set up an audio 
g 10 session with a specified destination. 



In response to event 388, the packet voice application 113 transitions to a 



RJ call signaling state 382 and reports the transition to the Communication Space 

fll 

£f| Station application 115. In response to event 390, the packet voice application 113 
transitions to an off hook state 384 and reports the transition to the Communication 
h^'l5 Space Station application 115. In response to event 392, the packet voice 
gl application 113 sends applicable call signaling messages to the packet voice 
tl gateway 232 to set up the audio session channel with the voice gateway 232 and 
provides for the voice gateway 232 to set up an appropriate audio session channel 
with the destination. The packet voice application 113 then transitions to the call 
20 signaling state 382, and reports the transition to the Communication Space Station 
application 115. 

When in the call signaling state 382, the packet voice application 113 is 
providing a ring signal to the subscriber as either a ring signal to notify the 
subscriber of an incoming audio session or to notify the subscriber that an audio 

25 session set up signal has been sent to the packet voice gateway 232 and a 
destination device is "ringing" waiting for a remote party to effectively answer the 
call. During the ringing state 382 the packet voice application 113 may detect 
events such as event 394 that represents receipt of a message that represents 
activation of the on/off hook button 109 (Figure 2), event 396 that represents 

30 termination of call signaling by the packet voice gateway 232, event 398 that 
represents receipt of a ready for audio session signal from the packet voice 
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gateway 232 if the packet voice application 113 is ringing to notify the subscriber 
that a remote device Is ringing. 

In response to either event 394 (and event 396 if the subscriber station 24 is 
currently off hook), the packet voice application 113 returns to the standby state 
5 380 and report the state transition to the Communication Space Station application 
115. In response to event 398 (and event 396 if the subscriber station 24 is current 
on hook) the packet voice application transitions to an audio session state 386 and 
report the transition to the Communication Space Station application 115. 

When in the off hook state 384, the packet voice application 113 may be 
10 generating a dial tone through the voice system 130 as a prompt for the subscriber 
to use the keypad to enter a telephone number. During the off hook state 384, the 
packet voice application 113 may accept events such as event 400 that represents 
receipt of a message that represents key pad activation, event 402 that represents 
M validation of a number sequence as a complete telephone number that can be used 
15 to set up an audio session, and event 404 that represents receipt of a message that 

i"^" represents activation of the on/off hook button 109 (Figure 2). 

CI 

ii| In response event 400 the packet voice application 113 generates a DTMF 

tone through the voice system 130 to provide the subscriber with audio feedback 
and stores the numeral as part of the sequence for validation. In response to event 
20 402, the packet voice application 113 initiates call signaling to the packet voice 
gateway 232 utilizing the validated number as the destination, transitions to the call 
signaling state 382, and reports the transition to the Communication Space Station 
application 115. In response to event 404, the packet voice application 113 
transitions to the standby state 380 and reports the transition to the Communication 
25 Space Station application 115. 

When in the audio session state 386 the packet voice application 113 is 
relaying messages representing a real time audio dialog between the voice system 
130 and the packet voice gateway 232. When in the audio session state 386, the 
packet voice application 113 may accept events such as event 406 that represents 
30 termination of the audio session by the packet voice gateway 232, event 408 that 
represents receipt of a message that represents subscriber activation of a keypad 
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numeral, and event 410 that represents receipt of a message that represents 
activation of the on/off hook button 109 (Figure 2). 

In response to event 406, the packet voice application 113 returns to the off 
hook state and reports the transition to the Communication Space Station 
application. In response to event 408, the packet voice application 113 generates a 
DTMF tone in the audio session signals to the packet voice gateway 232. In 
response to event 410, the packet voice application 113 returns to the stand by 
state 380 and reports the state transition to the Communication Space Station 
application 115. 

It should be appreciated that the systems and methods of the present 
invention provide for the communication and control of multi-media messages by a 
central control unit and a plurality of space station communication devices 
operating under the control of the control unit. This coordinated and integrated 
system architecture enables the space station communication device to merge the 
functionality and internal data of various portable subscriber devices into the space 
station communication device, to direct the functionality and data of the space 
station communication device to a selected one of the portable subscriber devices, 
and to provide the subscriber with a simple subscriber interface. 

Although the invention has been shown and described with respect to 
certain preferred embodiments, it is obvious that equivalents and modifications will 
occur to others skilled in the art upon the reading and understanding of the 
specification. For example, the above described processing states, events, and 
processing steps for both the subscriber station 42 and the session control server 
230 are exemplary states only for demonstrating operation and are not intended to 
limit the scope of the present invention. It is envisioned that after reading and 
understanding the present invention those skilled in the art may envision other 
processing states, events, and processing steps to further the objectives of the 
modular multi-media communication management system of the present invention. 
The present invention includes all such equivalents and modifications, and is 
limited only by the scope of the following claims. 
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